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Abstract 

We  report  on  the  design  and  analysis  of  a  controller  that  can  achieve  dynamical 
self-righting  of  our  hexapedal  robot,  RHex.  We  present  an  empirically  tuned  con¬ 
troller  that  works  reasonably  well  on  indoor  surfaces,  using  a  hybrid  energy  pump¬ 
ing  strategy  to  overcome  torque  limitations  of  its  actuators.  Subsequent  modeling 
and  analysis  yields  a  new  controller  with  a  much  wider  domain  of  success  as  well 
as  a  preliminary  understanding  of  the  hybrid  control  strategy.  Simulation  results 
demonstrate  the  superiority  of  the  improved  control  strategy  relative  to  the  first 
generation  empirically  designed  controller. 
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1  Introduction 


RHex  is  an  autonomous  hexapod  robot  that  negotiates  badly  irregular  terrain  at  speeds  better  than  one  body 
length  per  second  [8] .  In  this  paper,  we  report  on  efforts  to  extend  RHex’s  present  capabilities  with  a  self- 
righting  controller.  Motivated  by  the  successes  and  limitations  of  an  empirically  developed  “energy  pumping” 
scheme,  we  introduce  a  careful  multi-point  contact  and  collision  model  so  as  to  derive  the  maximum  benefit 
of  our  robot’s  limited  power  budget.  A  comparative  simulation  study  suggests  that  the  new  controller  will 
extend  significantly  the  terrain  over  which  the  self-righting  maneuver  succeeds. 

Autonomy  is  an  essential  component  for  any  robotic  platform  designed  to  operate  in  the  real  world.  In 
addition  to  strict  power  and  computational  constraints  it  imposes  on  the  design,  it  also  requires  basic  self¬ 
manipulation  capabilities  for  the  survivability  of  the  robot  in  the  absence  of  a  human  operator.  Even  during 
teleoperation,  where  the  computational  demands  on  the  platform  are  less  stringent,  the  ability  to  recover 
from  unexpected  situations  through  self-manipulation  is  essential.  Application  such  as  planetary  rovers  and 
space  missions  are  among  the  best  examples  where  these  requirements  are  most  critical  [1]. 

Recovery  of  correct  body  orientation  is  among  the  simplest  of  self-manipulation  tasks.  In  cases  where  it 
is  impossible  for  a  human  operator  to  intervene,  the  inability  to  recover  from  a  simple  fall  can  completely 
render  a  robot  useless.  Especially  in  outdoor  environments  with  badly  broken  terrain  and  obstacles  of  various 
shapes  and  sizes,  the  debilitating  effects  of  such  accidents  have  been  observed  in  the  past  [2] . 

RHex’s  morphology  is  roughly  symmetric  with  respect  to  the  horizontal  plane,  and  allows  nearly  iden¬ 
tical  upside-down  or  right-side  up  operation,  a  solution  adopted  by  other  mobile  platforms  [7].  However, 
various  scenarios  such  as  teleoperation  and  vision  based  navigation  entail  a  nominal  orientation  as  a  result 
of  the  accompanying  instrumentation  and  algorithms.  Under  these  constraints,  most  existing  robotic  de¬ 
signs  with  self-righting  capabilities  incorporate  special  kinematic  structures  such  as  long  extension  arms  or 
reconfigurable  wheels  [6,  9].  In  consequence  of  weight  and  power  limitations,  RHex  is  not  equipped  with 
such  structures  and  must  rely  on  its  existing  morphology  together  with  dynamic  maneuvers  to  perform  a 
flip-over. 

Through  an  empirical  design  process,  we  have  been  able  to  construct  a  controller  capable  of  inducing  a 
dynamical  back  flip  in  RHex.  The  applicability  of  this  controller,  however,  is  limited  to  a  small  range  of 
simple  surfaces,  such  as  linoleum,  smooth  concrete  and  carpet,  outside  which  the  robot  cannot  successfully 
flip  over.  We  present  in  this  paper  a  new  model  and  a  controller  derived  from  it  that  promises  to  extend 
significantly  the  variability  of  terrain  over  which  the  desired  behavior  will  be  achieved.  Beyond  the  existing 
behavior  and  the  new  multiple  point  collision/contact  model,  the  main  contributions  of  the  paper  are  a  torque 
control  strategy  that  maximizes  the  energy  injected  into  the  system,  validated  for  now  by  a  comparative 
simulation  study  and  a  second  empirical  study,  presently  in  progress. 


2  Flipping  RHex 

2.1  Simple  Open  Loop  Control 

Our  first  generation  flipping  controller  consists  of  a  state  machine  (see  Figure  1).  Starting  from  a  stationary 
position  on  the  floor,  the  robot  very  quickly  (in  0.2s)  goes  through  two  configurations  (poses  I  and  II  in 
Figure  1),  with  front  and  middle  legs  successively  leaving  the  ground.  Depending  on  the  frictional  properties 
of  the  ground,  these  motions  result  in  some  initial  kinetic  energy  of  the  body  that  may  in  some  cases  be 
sufficient  to  allow  “escape”  from  the  gravitational  potential  well  of  the  initial  configuration  and  fall  into 
the  other  desired  configuration.  However,  on  most  surfaces  —  gravel,  grass  and  asphalt,  but  even  some 
indoor  settings  such  as  carpet  —  this  is  not  sufficient  to  flip  the  body  over.  Instead,  the  robot  reaches  some 
maximum  pitch  lying  within  the  basin  of  the  original  configuration,  and  the  robot  falls  back  toward  its  initial 
state.  Under  these  circumstances,  the  controller  brings  the  legs  back  to  Pose  I  of  Figure  1  and  waits  for 
the  impact  of  the  front  legs  with  the  ground,  avoiding  negative  work  a  waste  of  battery  energy  given  the 
familiar  power-torque  properties  of  RHex’s  conventional  DC  motors.  The  impact  of  the  front  legs  with  the 
ground  in  their  kinematically  singular  configuration  recovers  some  of  the  body’s  kinetic  energy,  followed  by 
additional  thrust  from  the  middle  and  back  legs,  during  the  period  of  decompression  and  flight  of  the  front 
leg  —  i.e.,  during  a  phase  interval  when  it  is  possible  for  the  legs  in  contact  to  perform  positive  work  on 
the  robot’s  mass  center.  Thrusting  is  achieved  by  running  a  high  gain  proportional  derivative  control  (PD) 
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concrete 

linoleum 

carpet 

90% 

100% 

90% 

asphalt 

grass 

gravel 

100% 

0% 

0% 

Table  1:  Success  rates  of  the  first  generation  controller  for  10  experiments  each  on  different  surfaces. 


law  around  a  judiciously  selected  constant  velocity  leg  sweep  motion.  The  maximum  pitch  attained  by  the 
body  increases  with  each  bounce  up  until  the  point  where  collision  losses  are  exceed  the  energy  that  can  be 
be  imparted  by  the  PD  controller  during  the  leg  sweep  phase  interval.  As  Table  1  suggests,  this  pumping 
strategy  works  very  reliably  on  a  number  of  common  surfaces  such  as  linoleum,  smooth  concrete,  carpet  and 
asphalt. 


Start 


-©■ 


Thrust  I 


Pose  I 

C' 

^  Collision 

Impact 

fv 

Thrust  II 


Pose  II 

Figure  1:  Sequence  of  states  for  the  flipping  controller 


However,  on  many  surfaces  —  the  outdoor  environments  most  relevant  to  RHex’s  presumed  mission  [1,  8] 
such  as  loose  gravel,  grass  and  soft  ground  —  it  does  not  perform  nearly  as  well.  To  permit  a  reasonable 
degree  of  autonomous  operation,  we  would  like  to  improve  on  the  range  of  conditions  flipping  can  function. 
This  requires  a  more  aggressive  torque  generation  strategy  for  the  middle  and  rear  legs.  However,  empirically, 
we  find  that  driving  all  available  legs  with  the  maximum  torque  allowed  by  the  hip  motors  results  in  the 
body  lifting  off  the  ground  into  stance  mode,  still  in  the  wrong  configuration.  We  require  a  strategy  that 
can  be  tuned  carefully  enough  to  produce  larger  torques  aimed  specifically  at  pitching  the  body  over.  This 
requires  a  detailed  model  of  the  manner  in  which  the  robot  can  elicit  ground  reaction  forces  in  consequence 
of  hip  torques  operating  at  different  body  states  and  assuming  varying  leg  contact  configurations. 

2.2  Assumptions  and  Control  Design  Constraints 

Several  assumptions  constitute  the  basis  for  our  modeling  and  analysis  of  the  flipping  behavior. 

A  1  The  flipping  behavior  is  primarily  planar. 

The  controller  described  in  the  previous  section  operates  contralateral  pairs  of  legs  in  synchrony.  The 
robot’s  response  lies  almost  entirely  in  the  sagittal  plane,  and  departures  are  rare  enough  to  be  negligible. 

A  2  The  leg  masses  are  negligible  in  flight. 

We  assume  that  the  leg  masses  are  sufficiently  small  so  that  their  effect  on  the  body  dynamics  when  they 
are  not  in  contact  with  the  ground  is  negligible.  However,  we  still  need  to  consider  the  masses  of  the  stance 
legs  in  formulating  the  dynamics  in  order  to  avoid  peculiar  singularities  arising  from  the  nonzero  hip  torque 
actuation. 

A  3  The  tail  of  the  body  should  keep  contact  with  the  ground  throughout  the  flipping  action. 
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This  assumption  is  motivated  by  a  number  of  observations  gathered  during  the  empirical  flipping  experi¬ 
ments  presented  above.  First,  during  the  initial  thrust  phases,  the  front  legs  provide  most  of  the  torque.  The 
configurations  where  the  tail  endpoint  of  the  body  is  in  contact  with  the  ground  yield  the  longest  duration 
of  contact  for  the  front  leg,  harvesting  the  most  possible  benefit  from  the  associated  actuator  until  it  leaves 
the  ground. 

It  is  also  clear  that  one  would  not  want  to  go  through  the  vertical  configuration  of  the  body  when  the 
tail  endpoint  is  not  in  contact  with  the  ground  as  such  configurations  require  overcoming  a  higher  potential 
energy  barrier  and  would  be  less  likely  to  succeed. 

Finally,  collisions  of  the  body  with  the  ground,  which  introduce  significant  losses  due  to  the  high  damping 
in  the  body  structure  designed  to  absorb  environmental  shocks,  can  be  avoided  by  preserving  contact  with 
the  ground  throughout  the  flipping  action. 

In  light  of  these  assumptions,  our  controller  designs  face  two  major  constraints:  keeping  the  tail  endpoint 
of  the  body  on  the  ground  and  respecting  the  torque  limitations  of  the  actuators. 

3  The  Planar  Flipping  Model 

3.1  A  Generic  Planar  Model 

Based  on  A3,  our  analysis  will  be  largely  confined  to  configurations  where  the  tail  of  the  body  is  constrained 
to  lie  on  the  ground.  In  this  section,  we  describe  a  slightly  more  generic  model  to  prepare  a  formal  framework 
in  which  we  define  these  constraints.  Section  3.3  then  presents  the  much  simpler,  single  degree  of  freedom 
model  that  will  be  used  in  our  algorithm  design  and  subsequent  analysis  (presently  in  progress). 


II 

Figure  2:  Simple  rigid  planar  model  of  RHex 


Figure  2  illustrates  our  unconstrained  planar  model.  Three  rigid  legs  with  point  masses  m  on  the  toes 
are  attached  to  a  rigid  body  with  mass  M  and  inertia  1^.  The  toe  masses  are  only  effective  when  the  leg  is 
touching  the  ground  and  are  neglected  when  the  leg  is  in  flight.  The  attachment  points  of  the  legs  are  fixed, 
along  a  straight  line  through  the  center  of  mass.  This  line  also  defines  the  orientation  of  the  body,  0,  with 
respect  to  the  horizontal.  The  body  extends  between  the  points  N  and  T,  defined  to  be  the  “nose”  and  the 
“tail” ,  respectively.  The  center  of  mass  is  midway  between  N  and  T,  resulting  in  a  body  length  of  2d. 

The  nose,  the  tail  and  the  toes  cannot  penetrate  the  ground.  We  assume  that  the  body-ground  friction  is 
infinite  thereby  precluding  any  possibility  of  horizontal  slip  of  the  tail  and  the  nose.  In  contrast,  horizontal 
motion  of  the  toes  along  the  ground  is  central  to  the  behavior  of  interest.  We  model  the  toe  ground  interaction 
as  characterized  by  Coulomb  friction  with  dynamic  coefficient  fj.  and  viscous  friction  with  damping  constant 
kd .  Table  2  summarizes  the  notation  used  throughout  the  paper. 
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States  and  dependent  variables 

d  £  Q 

Body  angle  wrt  horizontal  (ccw) 

q:=  [ 9,9}  £TQ 

State  vector 

bz 

Coordinates  of  the  body  COM 

Leg  angle  wrt  the  body  vertical 

7 i 

Leg  angle  wrt  the  horizontal  (cw) 

Xi 

Horizontal  position  of  the  toe  mass 

Control  inputs 

T  £  R3 

Hip  torque  control  vector 

T(<\,P) 

Set  of  allowable  torque  vectors 

Model  parameters 

d,di,l 

Kinematic  parameters 

M,Ib,m 

Body  mass  and  inertia,  toe  mass 

7c 

Toe  angle  at  leg-ground  collision 

kr 

Leg-ground  coefficient  of  restitution 

Various  sets 

HuHb 

Leg  and  body  contact  state  spaces 

Table  2:  Notation  used  throughout  the  paper. 

3.2  Contact  States  and  Constraints 

In  this  section,  we  introduce  a  framework  for  modeling  the  interaction  of  the  body  and  the  legs  with  the 
ground.  Five  binary  flags,  —  a  pair  for  the  body  end  points  (the  nose  and  the  tail),  and  a  triple  for  the  legs, 
denoted,  respectively,  as  sn,  st,  si,  s2,  S3  —  are  sufficient  to  encode  the  contact  configurations  of  the  system 
within  the  contact  state  spaces  Hb  and  Hi, 


[(«n,  st),  (si,s2,  S3)]  £HbxHi 
Hb  :=  {0, 1}  x  {0, 1}, 

Hi  :=  {0,1}  x  {0,1}  x  {0,1}. 

For  any  s  €  Hu  we  use  Sj  to  denote  the  corresponding  contact  state  for  the  ith  leg  for  i  =  1,2,3.  In  the 
sequel,  we  will  find  it  useful  to  introduce  a  partial  order  on  Hi  imposed  by  the  following  relation, 

Definition  1  Let  p,r  £  Hi.  We  denote  by  the  symbol  >,  the  following  relation 

(p  >  r)  <=>■  ((Vi  pi  =  0  -»  n  =  0))  (1) 

Lemma  1  The  relation  >  is  a  partial  order  on  Hi . 

Proof:  >  is  clearly  reflexive  and  transitive.  Also,  if  p  >  r  and  r  >  p,  then  we  have  Vi,  Pi  =  ry,  which  implies 
that  p  =  r.  Hence,  >  is  also  antisymmetric.  □ 

The  morphology  of  our  model  requires  that  the  endpoints  of  the  body  be  above  the  ground, 

bz  >  cZ  sin  1 0 1 ,  (2) 

and  that  a  leg  must  reach  the  ground 

di  sin  0  >  l  —  bz  (3) 

before  it  can  apply  any  torque  to  the  body. 
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d 

(m) 

d\ 

(m) 

d2 

(m) 

d  3 

(m) 

l 

(m) 

M 

(kg) 

h 

(kgm2) 

m 

(kg) 

0.28 

-0.2 

0 

0.2 

0.12 

7.5 

0.18 

0.1 

Table  3:  RHex’s  Kinematic  and  dynamic  parameters. 


Note  that  three  instances  of  the  leg  contact  constraint  (3),  partition  the  space  of  valid  configurations  into 
four  different  regions,  (see  Figure  3),  within  which  certain  legs  are  required  to  be  in  flight. 


bs 


Figure  3:  Hybrid  regions  in  the  planar  flipping  model  in  (a)  the  bz  —  9  plane  (b)  polar  coordinates  with  angle 
9  and  radius  bz  using  RHex’s  morphology  (see  Table  3).  Solid  lines  indicate  body  ground  contact  for  the  nose 
(  9  <  0)  and  the  tail  (  9  >  OJ.  The  liftoff  transitions  of  the  front,  middle  and  back  legs  are  represented  with 
dotted,  dash-dot  and  dashed  lines,  respectively. 


3.3  The  1DOF  Planar  Model 

Our  subsequent  analysis  mainly  concerns  configurations  where  the  tail  of  the  body  is  in  contact  with  the 
ground  and  all  the  legs  are  positioned  such  that  0  <  7*  <  ir/2.  Our  controller  design  in  Section  4  respects 
these  constraints  by  proper  choice  of  control  inputs,  reducing  the  system  to  only  one  degree  of  freedom:  the 
body  angle  9  with  respect  to  the  horizontal.  As  a  convention,  we  assume  that  the  tail  coincides  with  the 
origin. 

The  foot  position  and  leg  orientation  can  then  be  expressed  as  functions  of  9, 


7 i 

Xi 


asin 


di  T  d 

l 


sin  9 


(di  +  d)  cos  9  +  l  cos  7 i  . 


(4) 

(5) 


We  will  also  find  it  convenient  to  write  the  leg  contact  constraints  of  (3)  in  functional  form  for  this  low 
degree  of  freedom  model,  sc  :  Q—*Hi,  with  the  component  for  the  ith  leg  specified  as 


,  n  \  1  if  sin 9<l/(d  +  di) 

Sc^  1  (0  otherwise 

In  the  context  of  this  low  degree  of  freedom  model,  we  will  refer  to  the  dynamical  state  of  the  system,  q, 
as  the  body  state  and  the  discrete  leg  touchdown  configuration  as  the  contact  state. 
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3.4  Continuous  Dynamics 

In  this  section,  we  derive  the  contact  constraint  forces  and  the  vector  field  for  the  constrained  model  of 
Section  3.3,  for  a  particular  choice  of  contact  state,  assuming  that  the  legs  that  are  touching  the  ground  as 
well  as  the  tail  of  the  body  are  vertically  constrained  in  both  directions  (i.e.  the  ground  reaction  force  can 
be  negative  as  well  as  positive) .  We  then  present  the  final  form  of  the  equations  of  motion  using  the  actual 
contact  state  sm(q,  r)  <  sc(6),  defined  in  Section  3.5  to  yield  the  continuous  dynamics  for  our  model. 


Figure  4:  Free  body  diagrams  for  the  body  and  one  of  the  legs 


Figure  4  illustrates  the  free  body  diagrams  for  the  body  link  as  well  as  one  of  the  legs  in  contact  with 
the  ground.  Solving  the  force  and  moment  balance  equations  for  leg  i,  we  have, 

( l  cos  7 i  +  lfti  sin  7i)Fi  =  Ima-  sin  7 *  —  Imb ® 0  sin  7 i  —  Ti  +  kdii  (6) 

where  pi  :=  —p  sign(ii)  is  defined  as  the  effective  Coulomb  friction  coefficient,  kd  is  the  frictional  damping 
constant  and  Xi  =  a*  —  bf  9  is  obtained  by  differentiating  (5)  twice. 

Combined  with  the  moment  balance  for  the  body  link  around  the  tail,  instances  of  (6)  for  each  leg  that 
can  reach  the  ground  result  in  a  linear  set  of  equations  whose  solution  yields  the  dynamics. 

The  number  of  these  equations,  however,  varies  based  on  the  value  of  sc{6).  The  following  presentation 
assumes  that  all  the  legs  can  reach  the  ground,  i.e.  sc(0)  =  [1,1,1],  but  the  readers  should  note  that  there 
are  23  =  8  different  cases  for  different  contact  states.  According  to  the  free  body  diagram,  we  may  write 


Ap(q)  v  =  b(q,r) 


(7) 


where  q  €  TQ,  p  = 
specified  as  follows: 


[pi,P2,P3]  €  Hi  is  an  arbitrary  contact  state  such  that  p  <  sc(6)  and  the  arrays  are 


Ap(q)  := 


fi  0  0 

0  h  0 

00/3 
Pi*!  P2X2  P3X3 


Imbi  sin  71 
Zm&2  sin  72 
Zm&f  sin  73 
~(Ib  +  Md2) 


(8) 


b(q,  t )  := 


Im  af  sin  71  +  kdi  1  — 
Im  of  sin  72  +  kdx2  — 
Im  of  sin  73  +  kd.x 3  — 
Mgd  cos  0 

F\  F2  F3  9  }T 


fi  ■=  l  cosy;  +  Ipi  sin7i  . 


Tl 

T2 

T3 


(9) 
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Lemma  2  Suppose  0  <  9  <  7r/2,  6  >  0  and  0  <  7 *  <  7r/2  (the  normal  range  of  operation  for  our  thrust 
controller) .  Then  the  matrix  Ap(q)  is  full  rank. 

Proof:  We  first  rewrite  Ap(q)  in  the  form  of  four  column  vectors 

Ap(q)  =  [  wi  w2  w3  wa  ] 

For  the  given  range  of  states,  the  foot  locations  27  are  clearly  positive.  Moreover,  as  a  consequence  of  (9), 
together  with  the  assumption  that  6  <  0  we  have  ft  >  0.  Finally,  differentiation  of  (5)  also  yields  bf  >  0. 
Now,  suppose  CiWi  =  0  for  some  c*  G  R.  The  first  three  rows  of  this  vector  sum  yield 

c^lmbf  sin  7,  . 

ci  = - , -  *  =  1,2,3. 

Ji 

Substitution  in  the  fourth  row  of  the  vector  sum  reads 

— C4  ^ ' Irn  ^  ^  SpPixt  +  h  +  Mcf'j  =  0. 

Clearly,  the  sum  within  the  parentheses  is  strictly  positive,  yielding  Cj  =  0  for  i  =  1,  ..,4.  Consequently, 
the  column  vectors  tty  are  linearly  independent  and  the  matrix  Ap(q)  has  full  rank.  □ 

As  a  consequence  of  Lemma  2,  the  matrix  Ap(q)  is  always  invertible  in  the  range  of  operation  for  our 
controller.  Consequently,  the  solution  to  (7)  yields  the  ground  reaction  forces  on  the  legs  as  well  as  the 
vector  field  for  the  particular  contact  state  choice  p, 


vp(q,  t)  :=  Ap(q)  1  b(q,r)  .  (10) 

The  final  form  of  the  equations  of  motion  uses  the  actual  contact  state,  p  =  sm(q,r),  defined  in  Section 


3.5, 


%r)  =  [0  0  0  1]  ASmM(q)  Xb(q, r)  (11) 

and  only  depends  on  the  current  body  state  and  the  torque  input  vector,  the  value  of  the  contact  state 
already  being  determined. 

3.5  Hybrid  Leg  Contacts 

Given  the  current  state  q,  we  can  “read  off”  from  sc(9)  the  number  of  kinematically  possible  leg  contacts 
so  as  to  determine  the  dimension  of  the  square  array  Ap(q)  in  (7).  However,  only  when  a  specific  set  of 
torques,  r  G  R3,  is  imposed  at  a  specified  body  state,  q  €  TQ,  can  we  determine  the  actual  leg  contact  state 
according  to  the  function,  sm  :  TQ  x  R3  — >  Hi,  and  complete  the  specification  of  the  dynamics  in  (11).  The 
following  definitions  will  be  important  in  the  computation  of  sm  and  subsequent  discussions: 

Definition  2  p  £  Hi  is  called  consistent  at  a  particular  state  q  and  for  a  given  control  input  vector  r, 
denoted  conS[q  r](p),  if  and  only  if 


Wi  ( pi  =  !)-»■  Fi(q,  T,p)  >  0 


Definition  3  Let  p  £  Hi  be  a  contact  state,  p  is  maximal  at  q  and  r,  denoted  maximal [q  Ti (p) ,  if  and  only 

if 

cons[q,T](p)  ->■  (Vr  G  Hi  cons[qj1-]  (r)  ->  (p  >  r))  (12) 

We  prove  the  existence  and  uniqueness  of  the  maximal  contact  state  in  Appendix  A.  The  following 
Theorem  states  a  very  important  consequence  of  maximality. 


Theorem  1  If  p  G  TLi  is  the  maximal  contact  state  at  q  for  a  given  t,  then 

Vr  G  7 Hi,  (r  <  p)  ->  (9r( q,  r)  <  0p(q,  r)). 

Proof:  This  proof  is  a  continuation  of  the  existence  and  uniqueness  proof  for  the  maximal  contact  state  (see 
Appendix  A).  It  follows  trivially  from  the  last  row  of  the  vector  equality  (16).  □ 

Finally,  the  following  assumption  constitutes  the  basis  of  our  hybrid  leg  contact  model. 


A  4  The  contact  state  of  the  system  is  the  maximal  contact  state  for  its  current  body  state  q  and  the  control 
torque  vector  t. 

Based  on  this  assumption,  the  following  algorithm  computes  the  maximal  and  hence  the  actual  contact 
state  for  a  given  state  q  and  torque  vector  r. 

Algorithm  2  (Definition  of  sm  :  TQ  x  R3  — >  Hi) 

For  a  given  state  q  G  TQ  and  control  inputs  r  G  K3,  this  iterative  algorithm  determines  a  consistent 
contact  state  assignment  which  is  also  maximal. 

1.  Start  with  an  initial  assumption  for  the  leg  contact  states  based  on  the  kinematic  constraints. 


P°  =  sc(9) 


2.  Using  (7),  compute  the  ground  reaction  forces  Fi(pk)  residting  from  the  current  leg  contact  state  as¬ 
signment  pk . 

3.  If  Vi,  Fi(pk)  >  0,  pk  is  the  actual  touchdown  state,  stop  the  iterations.  Otherwise,  proceed  with  the 
next  step. 

4-  Choose  the  next  leg  touchdown  states  to  be  considered  as  follows. 

fc+i  f  P*  ifFt{pk)>  0 


Pi  = 


0  otherwise 


for  i  =  1,2,3 


5.  Go  to  step  2  with  k  k  +  1 


3.6  Leg-Ground  Collisions 

The  flipping  behavior  described  in  Section  2.1  involves  collisions  of  the  front  legs  with  the  ground.  In  order 
to  recover  as  much  of  the  impact  kinetic  energy  as  possible  before  each  thrust  cycle,  our  controllers  position 
the  front  leg  vertically  prior  to  impact,  resulting  in  the  radial  compliance  of  the  leg  to  do  most  of  the  work. 
The  vertical  placement  also  avoids  slippage  of  the  leg  as  well  as  friction  losses  and  eliminates  the  need  for  the 
motor  to  apply  any  torque  during  the  collision  due  to  the  kinematically  singular  configuration.  Moreover, 
during  the  decompression  of  the  front  leg,  the  middle  and  back  legs  can  still  apply  additional  thrust  to  inject 
energy  even  during  the  collision.  We  will  find  it  convenient  to  summarize  the  results  of  the  entire  front  leg 
stance  phase  via  an  effective  “coefficient  of  restitution”  model  whose  nature  we  now  detail. 

In  order  to  derive  an  accurate  model  of  the  collision,  it  would  be  possible  to  extend  the  continuous 
dynamics  of  Section  3.4  to  incorporate  compliance  and  other  dynamical  reaction  forces  of  the  front  leg  so  as 
to  construct  a  “stance  phase”  model  that  might  then  be  integrated  to  obtain  a  more  accurate  prediction  of 
the  body  kinetic  energy  returned  at  the  next  leg  liftoff  event.  Examples  of  such  predictive  impulse  models 
can  be  found  in  the  literature  [5].  However,  the  accuracy  of  such  models  is  still  hostage  to  the  difficulty  of 
determining  the  dynamic  properties  of  materials  as  well  as  other  unmodeled  effects  [3] . 

In  consequence,  we  have  chosen  to  incorporate  a  purely  algebraic  collision  law  in  our  model,  where  a 
single  coefficient  of  restitution  summarizes  —  as  a  function  of  the  configuration,  6  and  the  “average  torque 
magnitude”  during  the  collision  stance  phase  —  the  incremental  effects  of  leg  compression/decompression 
and  additional  thrust  from  the  middle  and  back  legs. 

The  following  assumptions  underlie  the  construction  of  our  collision  law. 
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A  5  If  a  leg  is  in  flight,  its  angular  velocity  relative  to  the  body  is  always  zero  (fa  =  Q),  but  its  position  can 
be  arbitrarily  specified  under  the  constraint  that  the  toe  cannot  penetrate  the  ground. 

A  6  A  collision  occurs  whenever  the  body  is  falling  (  8  <Q),  and  a  leg  previously  in  flight  comes  into  contact 
with  the  ground  either  by  explicit  positioning  through  fa  or  by  the  virtue  of  changes  in  the  configuration  6  as 
a  result  of  the  dynamics. 

Accurate  modeling  of  multiple  simultaneous  collisions  is  a  very  fragile  and  somewhat  ill-posed  problem 
[4].  Accordingly,  by  design,  our  flipping  controller,  due  to  the  very  particular  sequence  of  leg  placements 
that  it  enforces,  never  encounters  multiple  simultaneous  collisions,  motivating  the  following  assumption. 

A  7  Multiple  simultaneous  collisions  are  not  allowed. 

In  RHex,  the  rebounding  of  the  body  as  a  result  of  leg  ground  collision  mainly  involves  the  radial 
compression  and  decompression  of  the  leg. 

A  8  During  the  collision,  we  assume  that  Ti  =  0  and  all  the  contact  forces  are  due  to  the  radial  compression 
of  the  leg.  As  a  consequence,  the  impulsive  force  at  the  contact  point  acts  along  the  leg. 

When  the  radial  leg  direction  lies  outside  the  friction  cone,  the  required  frictional  impulse  would  be 
greater  than  the  Coulomb  friction  force,  violating  one  of  the  basic  constraints  of  algebraic  collision  laws  [3]. 
Even  though  the  flipping  controller  always  chooses  leg  angles  prior  to  collision  to  satisfy  this  constraint, 
for  completeness,  we  augment  our  model  to  use  an  incremental  approach  through  the  dynamics  of  (11)  for 
collisions  outside  the  domain  of  the  algebraic  law. 

A  9  If  the  leg  touches  the  ground  outside  the  friction  cone  (i.e.  j  tan(0  +  fa)\  >  \x),  then  the  leg  immediately 
starts  slipping  and  transitions  into  stance  without  any  impulsive  collisions.  The  system  velocities  remain 
continuous  (0+  =  0~ ). 

Under  these  assumptions,  our  collision  law  models  the  damping  losses  arising  from  the  compression  and 
decompression  of  the  front  leg  as  well  as  the  additional  thrust  provided  by  the  middle  and  back  legs.  We 
assume  that  these  losses  can  be  lumped  into  a  single  coefficient  of  restitution  —1  <  kr( qc)  as  a  function  of 
the  toe  angle  at  the  onset  of  collision,  jc. 


8+  =  -kr( 7c)  9  (13) 

Note  that  as  a  result  of  Assumption  9,  kr( yc)  =  —1  whenever  |  cot(7c)|  >  p. 

3.7  Body  Contact  Forces  During  Collision 

The  collision  model  described  in  Section  3.6  implicitly  assumes  that  the  impulsive  forces  necessary  to  yield 
the  discontinuous  change  in  the  body  velocity  are  applied  both  at  the  toe  and  the  body-ground  contact  point. 
However,  the  constraints  imposed  by  these  contact  points  are  unilateral  and  only  allow  ground  reaction  forces 
with  positive  vertical  components.  If  the  necessary  impulsive  forces  violate  this  constraint,  the  collision  model 
becomes  invalid  and  some  unmodeled  behavior  (such  as  the  tip  of  the  body  leaving  the  ground)  will  arise. 
In  this  section,  we  derive  the  ground  reaction  forces  arising  from  the  collision  and  investigate  the  validity  of 
the  model  as  a  function  of  kinematic  robot  design  as  well  as  the  leg  configuration  at  the  time  of  collision. 

The  algebraic  law  of  (13)  can  only  be  realized  through  impulsive  forces  both  at  the  toe  and  at  the  body- 
ground  contact  point.  Figure  5  illustrates  the  impulsive  contact  forces  effective  during  the  collision.  Note 
that  P  acts  along  the  leg  as  aresult  of  Assumption  8. 

Moment  balance  around  the  point  O,  yields  the  leg  contact  impulse  P, 

p  (Ib  +  Md2){9+  —  9~) 

(d  +  di)  cos  fa 

The  step  change  in  the  translational  body  velocities  yield  the  body  ground  contact  impulses. 
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Figure  5:  Impulsive  contact  forces  during  leg-ground  collision 


Ptx  =  -Md  sin  0(0+ -0“)  +  Pcos  7* 

Pc2  =  Md  cos  0(0+  —  0_)  —  Psin7j 

Substituting  the  algebraic  collision  model  of  (13),  we  obtain 

Pc  =  (-MdsinO  +  ^  \  cos 7^  (1  +  kr(^ci))6~ 

V  («  +  «i)  COS  (f>i  J 

Pc  =  ( Md  cos  0  -  \  sin  7i)  (1  +  M7c))0_ 

V  (d  +  di)  cos  4>i  ) 


As  a  result  of  the  unilateral  contact  constraint,  our  collision  model  is  only  valid  when  Pcz  >  0.  Hence, 
the  regions  where  this  collision  model  is  valid  are  given  by  the  following  inequality. 


Md  cos  0  — 


(. h  +  Md2) 


sin  7 i  >  0 


(d  +  di)  cos  (j)i 

We  can  write  this  inequality  as  a  function  of  only  the  configuration  of  the  system  at  the  time  of  collision 
and  the  kinematic  robot  parameters,  yielding 


di  d 
l 


cos“  0  - 


(d  +  di)2  -2  a  a  d b 

1 - ~ - sin  0  cos  0  — 


Md2 


l 2 


Mid 


>0. 


(14) 


Figure  6. a  illustrates  regions  in  robot  configuration  and  design  space  where  our  algebraic  collision  model 
remains  valid.  Note  that  with  di  =  0.2  for  the  front  leg,  and  the  collision  occurring  with  the  leg  vertical 
(boundary  of  the  white  and  grey  regions),  the  model  is  valid  for  RHex’s  flipping  controller.  Furthermore, 
there  is  also  some  remaining  freedom  in  choosing  different  leg  angles  at  impact,  possibly  yielding  better 
restitution  coefficients  and  recovery  of  more  energy. 

This  is  much  more  clearly  illustrated  in  Figure  6.b,  where  model  validity  is  portrayed  in  a  slightly  different 
coordinate  system,  with  0  slaved  to  the  angle  of  the  hip  at  the  time  of  collision  <f>c. 


4  An  Improved  Controller 

4.1  Constraints  on  the  Control  Inputs 

Given  a  particular  contact  state  p ,  ground  reaction  forces  on  the  toes  can  be  determined  using  (6) .  Similarly, 
we  can  compute  the  contact  force  on  the  tail, 
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(a) 


(b) 


Figure  6:  Dependence  of  collision  model  validity  on  model  parameter  di  and  (a)  the  configuration  variable 
9 ,  (b)  the  hip  angle  fa.  The  gray  region  is  where  the  leg  cannot  reach  the  ground.  The  white  region  is  where 
the  ground  reaction  force  on  the  body  contact  has  a  positive  component  (i.e.  (14)  holds),  whereas  the  black 
region  is  where  the  algebraic  collision  model  becomes  invalid.  Note  that  in  the  second  graph,  a  larger  range 
for  fa  is  covered  and  9  is  slaved  to  the  hip  angle  through  a  kinematic  touchdown  condition. 


Ff  =  [— pT  Mdcos9]  vp(q, r)  +  Mg  -  Mdsm.9  92  . 

To  preserve  consistency  with  the  assumed  contact  state  in  a  physically  realistic  way,  all  of  these  ground 
reaction  forces  must  be  positive,  inducing  limitations  on  the  set  of  input  torque  vectors.  We  capture  these 
constraints  and  the  practical  limits  on  the  magnitude  of  the  input  torques  with  the  following  definition. 

Definition  4  For  a  particular  state  q  £  TQ  and  a  contact  state  p  €  Tti,  we  define  the  corresponding  set  of 
allowable  torques,  T(q,p)  as  the  set  of  all  torque  input  vectors  r£l3  such  that 

Fc(ci,  T,p)  >  0 

Vi,  Fi(q,T,p)  >  0 

Vi,  (t;  |  ft  'Trnax 

4.2  Maximal  Thrust  Control 

In  this  section,  we  present  a  torque  control  strategy  which  maximizes  the  thrust  while  respecting  the  body 
contact  constraint  as  well  as  limitations  on  the  torque  deliverable  by  the  hip  actuators. 

The  vector  field  (11)  is  a  continuous  function  of  the  state  and  the  input  torques.  As  a  consequence,  the 
problem  of  choosing  hip  controls  to  maximize  the  thrust  becomes  a  constrained  optimization  problem  over 
the  allowable  input  torque  space,  given  the  current  system  state  and  the  torque  limit  constraints.  However, 
different  regions  in  the  state  space  with  different  leg  contact  state  assignments  result  in  a  vector  field  which 
is  a  nonlinear  function  of  the  input  torques,  yielding  a  computationally  demanding  nonlinear  optimization 
problem. 

Fortunately,  in  each  of  the  distinct  leg  contact  states,  the  optimization  problem  is  linear  in  the  control 
input  torques.  Hence,  the  problem  decomposes  into  a  small  number  of  separate  linear  programming  problems, 
from  whose  independent  solutions  may  be  derived  a  single  correct  torque  value  for  the  three  hips.  Namely,  the 
optimal  torque  vector  is  computed  for  each  distinct  leg  contact  state  vector  compatible  with  the  kinematic 
constraints.  Then,  putative  motor  torques  determined  for  each  kinematically  possible  leg  contact,  the  unique 
physical  contact  state  vector  is  selected  by  recourse  to  Algorithm  1,  and  the  command  torque  vector  to  each 
motor  derived.  More  formally,  given  a  leg  contact  state  vector,  p  £  ~Hi,  we  pose  the  corresponding  linear 
programming  problem  for  that  region  of  configuration  state  space: 
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(0(q,  T,p) 

^M(q,p)  :=  0(c[,tm(<1,p),P )  • 


:=  argmax 

r  e  T(q,p) 


The  set  of  contact  state  assignments  that  we  need  to  consider  is  determined  by  the  kinematic  constraints, 
"Pq  :=  {p  GHi  |  sc(0)  >  p}.  The  solution  to  the  global  problem  then  becomes, 


T  =  r(q,  PmaX) 


(15) 


Pmax  ■=  argmax 


(6>M(q,p) 


Note  that  pmax  is  also  maximal  at  the  current  body  state  and  with  the  torque  solution  to  the  above 
optimization  problem  as  a  result  of  Claim  1.  Consequently,  the  actual  contact  state  determined  by  the 
algorithm  of  Section  3.5  will  necessarily  match  pmax ,  that  is 


Sm(<l,T(<l,Pmax))  — Pma 


4.3  Hybrid  Energy  Pumping 

Depending  on  the  frictional  properties  of  the  surface,  our  maximal  thrust  controller  may  or  may  not  be 
enough  to  complete  the  flip.  In  cases  where  it  fails  to  achieve  the  sufficient  energy  level  in  the  first  attempt, 
our  controller  uses  the  same  strategy  as  the  the  first  generation  controller  presented  in  Section  2.1.  Once 
the  body  starts  falling,  the  new  controller  waits  until  the  front  legs  collide  with  the  ground  and  repeatedly 
applies  maximal  thrust  following  each  collision. 

Currently,  we  have  very  little  analytical  understanding  of  the  behavior  arising  from  this  hybrid  controller. 
As  a  consequence,  we  only  explore  in  simulation  the  flipping  behavior  and  its  dependence  on  various  surface 
parameters  in  the  following  sections. 


5  Simulations 

In  this  section,  we  use  simulations  based  on  the  dynamical  model  of  Sections  3.4  and  3.5  to  evaluate  the 
performance  of  the  maximal  thrust  control  approach  combined  with  the  hybrid  energy  pumping  strategy. 

5.1  Apex  Return  Maps 

Figure  7  illustrates  an  example  simulation  of  a  successful  flip  with  multiple  hops.  Note  that  in  the  last  cycle, 
as  the  robot  “escapes”  from  the  basin  of  attraction  of  the  initial  configuration,  the  point  of  inflection  at 
t  w  4.5  corresponds  to  the  configuration  where  the  downward  torque  from  gravity  is  just  balanced  by  the 
rear  leg  thrusting  torque. 

In  presenting  the  properties  of  the  hybrid  pumping  strategy,  we  will  find  it  most  convenient  to  sample 
the  9  trajectory  at  its  highest  point  (apex)  during  each  cycle.  This  will  result  in  a  one  dimensional  return 
map,  characterizing  the  behavior  of  the  energy  pumping  strategy  under  the  maximal  thrust  actuation.  This 
section  explores  on  the  basis  of  numerical  simulation  some  of  the  properties  of  this  return  map  and  their 
dependence  on  various  surface  parameters  and  the  coefficient  of  restitution.  Formal  analysis  of  this  model 
is  presently  in  progress. 

Figure  8  illustrates  different  types  of  return  maps  resulting  from  different  choices  of  the  surface  parameters 
p,  kc  and  kd ■  This  collection  of  return  maps  appears  to  capture  all  the  possible  types  of  phenomena  that 
arise  from  our  hybrid  controller. 

The  upper  left  case  has  low  ground  friction  and  hence  the  initial  thrust  is  sufficient  to  flip  the  robot  body 
over.  Moreover,  there  is  no  fixed  point,  so  even  if  the  robot  were  to  start  off  the  ground,  it  would  always  be 
able  to  flip.  In  contrast,  the  upper  right  case  has  enough  friction  to  make  flipping  in  one  thrust  impossible, 
but  still  has  no  fixed  point,  yielding  successful  flipping  after  several  hops. 
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Figure  7:  An  example  simulation  of  (11)  with  RHex  parameters  (see  Table  3)  and  /i  =  0.8,  kd  =  11  and 
kc  =  0.75;  using  the  maximal  thrust  feedback  controller  (15).  Dotted  and  dashed  lines  indicate  the  kinematic 
liftoff  constraints  for  the  front  and  middle  legs,  respectively. 


k  =  0.75,  |i=0.8,  kd  =  5 


ko  =  0.75,  (1=0.8,  kd=  10 


Figure  8:  The  predicted  range  of  physical  behaviors  based  upon  numerical  return  maps  computed  for  (11) 
with  representative  surface  parameter  settings  using  the  maximal  thrust  feedback  controller  (15). 


The  bottom  two  cases  have  qualitatively  different  behavior.  In  contrast  to  the  previous  cases,  they  have 
stable  fixed  points,  trapping  the  robot  at  a  small  angle.  For  the  bottom  left  case,  there  is  no  other  fixed 
point,  which  makes  it  impossible  for  the  robot  to  flip.  The  bottom  right  case,  however,  also  has  another 
unstable  fixed  point,  making  a  successful  flip  possible  for  initial  conditions  above  the  fixed  point. 

5.2  Maximal  Thrust  vs  PD  Control 

Results  of  simulation  runs  for  a  range  of  surface  friction  parameters  are  illustrated  in  Figures  9  and  10,  for 
kc  =  0.75  and  kc  =  0.9,  respectively.  The  simulations  were  run  over  a  range  of  surface  friction  properties, 
until  either  the  robot  flipped  over  or  at  the  end  of  50  hops.  A  particular  attempt  was  considered  a  successful 
flip  if  the  body  angle  reached  it/2  before  the  end  of  the  simulation  (labeled  single  thrust  and  multiple  hops  in 
the  plots) ,  or  the  sequence  of  apex  heights  kept  increasing  even  in  the  last  hops  (indicating  a  weakly  unstable 
fixed  point  in  the  return  map,  labeled  expected  flip  in  the  plots).  All  other  runs  were  considered  failed  flip 
attempts. 

One  of  the  reasons  for  the  choice  of  such  high  coefficients  of  restitution  is  the  active  nature  of  the 
collisions  we  briefly  describe  in  Section  3.6.  In  this  context,  higher  coefficient  of  restitutions  reflect  the 
additional  thrust  occurring  exerted  during  the  decompression  of  the  front  leg.  On  RHex,  we  observed  the 
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duration  of  the  collision  to  be  significant,  increasing  the  effect  of  this  active  phase  of  the  collision.  Actual 
values  of  the  coefficient  of  restitution  still  remain  to  be  experimentally  verified. 


Maximum  Thrust  PD  Control 


no  flip  expected  flip  multiple  hops  single  thrust 


Figure  9:  Outcomes  for  flipping  attempts  with  lower  coefficient  of  restitution,  kc  =  0.75 


These  results  demonstrate  that  maximal  thrust  control  yields  considerably  better  flipping  performance 
than  the  PD  control  in  all  cases.  For  smaller  kc,  where  the  “active”  collision  is  not  properly  modeled,  the 
PD  controller  never  succeeds  with  multiple  hops  and  only  has  a  chance  when  the  first  thrust  is  sufficient. 
When  the  effects  of  the  active  collision  are  incorporated  through  the  coefficient  of  restitution,  the  maximal 
thrust  controller  is  still  successful  in  a  very  large  range  of  surface  conditions  and  yields  strictly  better  results 
than  the  PD  control. 


6  Conclusion  and  Future  Work 

In  robotic  locomotion  research,  autonomy  is  likely  to  impose  some  of  the  most  demanding  constraints  on 
design  and  limitations  on  behavior.  It  is  very  difficult,  often  impossible  to  achieve  in  systems  otherwise 
designed  for  non-autonomous  operation.  RHex,  our  hexapedal  platform,  demonstrated  that  autonomy  as  a 
design  goal  can  achieve  significant  advances  in  real  world  performance  and  robustness. 

In  this  paper,  we  present  a  new  controller  to  implement  self-righting  behavior  on  RHex,  which  is  perhaps 
the  simplest  instance  of  self-manipulation  other  than  locomotion  itself.  Our  modeling  and  analysis  yields 
significant  improvements  to  the  simple  first  generation  controller,  extending  its  domain  of  success  to  a  wider 
range  of  terrain  conditions  -  between  three  to  five  times  the  range  (in  regard  to  the  effective  viscous  damping 
that  can  be  overcome).  Although  the  implementation  of  these  improvements  on  our  experimental  platform 
awaits  a  more  complete  sensory  suite,  we  believe  the  actual  performance  improvement  on  the  robot  will  be 
comparable  to  what  we  have  observed  in  simulation. 

More  formal  analysis  of  the  preliminary  model  we  have  described  in  this  paper  is  also  of  great  interest. 
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Figure  10:  Outcomes  for  flipping  attempts  with  higher  coefficient  of  restitution,  kc  =  0.9 


Extensions  of  the  flipping  behavior  such  as  uninterrupted  rolling  or  handstands  will  require  a  much  better 
analytical  understanding  of  the  model  as  well  as  modifications  such  as  relaxing  the  friction  constraint  on 
the  body.  We  believe  that,  such  extensions  to  the  behavioral  suite  of  a  morphology  as  limited  as  RHex,  is 
the  best  way  to  address  the  shortcomings  of  contemporary  actuation  and  energy  storage  technology  while 
continuing  to  press  ahead  in  the  development  of  practically  useful  robots. 
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A  Existence  and  Uniqueness  of  the  Maximal  Contact  State 

First,  we  will  need  to  state  some  of  the  properties  of  consistent  contact  state  assignments  and  the  partial 
order  defined  in  Section  3.2. 

Lemma  3  At  any  given  state  q  and  for  any  given  control  input  vector  r,  there  is  at  least  one  consistent  leg 
contact  state  assignment. 

Proof:  p  £  Tii  such  that  Mi  Pi  =  0  is  always  consistent.  □ 

Theorem  3  Let  p,r  £  Tti .  The  following  statement  holds 

{(p  >  r)  A  conS[q!r]  (p))  cons[q,Tj  (r)) 
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Proof:  If  p  =  r,  then  the  statement  holds  trivially.  So,  suppose  p  >  r,  p  r  and  that  p  is  consistent.  Let 
vp  :=  Ap(q)_1b(q,  r)  and  vr  :=  Ar(q)_1b(q,  t)  denote  the  solutions  of  (7),  for  both  leg  touchdown  state 
vectors  p  and  r,  respectively.  Noting  that  Ar(q)vr  =  b(q,  r)  =  Ap(q)vp,  we  have 


Ar(q)(vp  -  vr)  =  —  (Ap(q)  -  Ar(q))vp. 

The  matrices  Ap(q)  and  Ar(q)  have  the  same  elements  except  the  last  row,  where  the  components  of  p 
and  r  differ.  Let  J  be  the  set  of  indices  for  those  legs  j  such  that  pj  =  1  and  r3  =  0.  J  is  always  nonempty 
because  p  yf  r  and  p  >  r.  Consequently,  we  can  write 


-(Ap(q)  -  Ar(q))vp  =[0,0,  0,  ~YPjFi(p)xi  f 

jeJ 


Rewriting  Ar(q)  as  a  block  matrix,  we  have 


1  _ 

A-f(3x3) 

B(3x1) 

-1 

AG(3x3)  W(3xl) 

A(1ie3) 

*(1x3)  “-^(1x1) 

where  AG  :=  (AF  +  BD~1X)~1 ,  Z  :=  (D  +  XAF~  B)~x,  W  :=  A F~LBZ,  Y  :=  D~1XAG.  In  Lemma 
2,  we  have  shown  that  for  the  normal  operating  domain  of  our  model,  /,;  >  0.  Inspection  of  (8)  then  shows 
that  the  elements  of  the  diagonal  matrix  A F  and  its  inverse  as  well  as  B ,  X  are  positive.  Moreover,  D  >  0, 
yielding  D~l  >  0  and  Z  >  0  as  well.  Finally,  being  defined  as  products  of  matrices  with  positive  elements, 
W  and  Z  also  have  all  positive  elements.  As  a  consequence,  we  obtain  the  following  difference  in  the  solution 
vectors  for  p  and  r 


vp  -  vr  =  -Ar(q)  (Ap(q)  -  Ar(q))vp  = 


~  ^(3x1) 
■2(1x1) 


Y PjFi(p)xi . 


(16) 


By  definition  of  consistency,  we  have  Ft (p)  >  0.  Hence,  (16)  yields  Vz,  Fi(p)  —  Fi(r )  <  0.  We  now  have 

Vz  r,;  =  1  — >  Pi  =  1  — >  Fi(p)  >  0  ->  Fi(r)  >  0 

which,  by  definition,  implies  the  consistency  of  r.  □ 


Theorem  4  Let  p,r,  s  G  TLi-  The  following  statement  holds 

conS[q  T]  (p)  A  conS[q  T]  (r )  (p  >  r)  V  (r  >  p)  V  (3s  G  Hi  cons[q,T](s)  A  (s  >  p)  A  (s  >  r)) 
Theorem  5  (Existence  and  uniqueness  of  a  maximal  contact  state) 

In  any  given  state  q  and  for  a  given  control  input  vector  r,  there  is  always  a  unique  consistent  leg  contact 
state  assignment  which  is  also  maximal. 

Proof:  Suppose  that  there  are  no  maximal  leg  contact  state  assignments.  As  a  consequence,  for  all  leg 
contact  assignments,  the  opposite  of  (12)  must  hold,  namely 

Vp  G  Hi  nconS[q  T](p)  V  (3r  G  Hi  cons[qiT](r)  A  n(p  >  r))  (17) 

Now,  consider  the  following  inductive  construction.  Pick  po  to  be  a  consistent  leg  contact  state  assign¬ 
ment.  By  Theorem  3,  such  an  assignment  can  always  be  found.  For  the  inductive  step,  suppose  cons [q,r](pfe) 
holds.  By  (17),  we  can  always  find  r  G  Hu  which  is  consistent  such  that  either  r  >  pu  holds,  or  neither  p  >  r 
nor  r  >  p  hold.  If  r  >  Pk,  then  choose  Pk+i  =  f.  Otherwise,  using  Theorem  4,  we  can  always  find  s  G  Hi 
such  that  s  is  consistent,  and  it  is  greater  than  both  p  and  r.  Note  that  (s  yf  p)  A  (s  yf  r)  because  any  other 
case  would  imply  that  r  and  p  could  be  ordered.  We  can  now  choose  Pk+i  =  s. 

This  inductive  construction  results  in  an  infinite  ordered  sequence  {p;,-}  such  that  V/c  G  N,  (pk+i  > 
Pk)  A  (pfc+i  yf  Pk)-  However,  we  know  that  Hi  is  finite,  therefore,  there  exists  at  least  one  maximal  leg 
contact  state  assignment  for  any  given  state  and  control  input  vector.  □ 
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